Papers with training-based routers face
SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models incur high inference costs during deployment, causing hallucination . no dedicated routing methods exist for RAG, and existing training-based routers face challenges scaling to this domain . |
| Approach: | They propose a plug-and-play routing framework that optimizes performance and cost . the framework delivers over 3x higher routing effectiveness while reducing runtime to less than 0.001x . |
| Outcome: | The proposed framework delivers over 3x higher routing effectiveness while reducing runtime to less than 0.001x compared to existing methods. |